Generative AI in production: Rethinking development and embracing best practices

For apps built on LLMs, the engineering mindset of predictable debugging and software testing and monitoring is suddenly challenged.